ABSTRACT
BACKGROUND: Accurate assessment of COVID-19 severity in the community is essential for patient care and requires COVID-19-specific risk prediction scores adequately validated in a community setting. Following a qualitative phase to identify signs, symptoms, and risk factors, we aimed to develop and validate two COVID-19-specific risk prediction scores. Remote COVID-19 Assessment in Primary Care-General Practice score (RECAP-GP; without peripheral oxygen saturation [SpO2]) and RECAP-oxygen saturation score (RECAP-O2; with SpO2). METHODS: RECAP was a prospective cohort study that used multivariable logistic regression. Data on signs and symptoms (predictors) of disease were collected from community-based patients with suspected COVID-19 via primary care electronic health records and linked with secondary data on hospital admission (outcome) within 28 days of symptom onset. Data sources for RECAP-GP were Oxford-Royal College of General Practitioners Research and Surveillance Centre (RCGP-RSC) primary care practices (development set), northwest London primary care practices (validation set), and the NHS COVID-19 Clinical Assessment Service (CCAS; validation set). The data source for RECAP-O2 was the Doctaly Assist platform (development set and validation set in subsequent sample). The two probabilistic risk prediction models were built by backwards elimination using the development sets and validated by application to the validation datasets. Estimated sample size per model, including the development and validation sets was 2880 people. FINDINGS: Data were available from 8311 individuals. Observations, such as SpO2, were mostly missing in the northwest London, RCGP-RSC, and CCAS data; however, SpO2 was available for 1364 (70·0%) of 1948 patients who used Doctaly. In the final predictive models, RECAP-GP (n=1863) included sex (male and female), age (years), degree of breathlessness (three point scale), temperature symptoms (two point scale), and presence of hypertension (yes or no); the area under the curve was 0·80 (95% CI 0·76-0·85) and on validation the negative predictive value of a low risk designation was 99% (95% CI 98·1-99·2; 1435 of 1453). RECAP-O2 included age (years), degree of breathlessness (two point scale), fatigue (two point scale), and SpO2 at rest (as a percentage); the area under the curve was 0·84 (0·78-0·90) and on validation the negative predictive value of low risk designation was 99% (95% CI 98·9-99·7; 1176 of 1183). INTERPRETATION: Both RECAP models are valid tools to assess COVID-19 patients in the community. RECAP-GP can be used initially, without need for observations, to identify patients who require monitoring. If the patient is monitored and SpO2 is available, RECAP-O2 is useful to assess the need for treatment escalation. FUNDING: Community Jameel and the Imperial College President's Excellence Fund, the Economic and Social Research Council, UK Research and Innovation, and Health Data Research UK.
Subject(s)
COVID-19 , Dyspnea , Female , Humans , Male , Primary Health Care , Prospective Studies , Risk FactorsABSTRACT
BACKGROUND: Since the start of the COVID-19 pandemic, efforts have been made to develop early warning risk scores to help clinicians decide which patient is likely to deteriorate and require hospitalization. The RECAP (Remote COVID-19 Assessment in Primary Care) study investigates the predictive risk of hospitalization, deterioration, and death of patients with confirmed COVID-19, based on a set of parameters chosen through a Delphi process performed by clinicians. We aim to use rich data collected remotely through the use of electronic data templates integrated in the electronic health systems of several general practices across the United Kingdom to construct accurate predictive models. The models will be based on preexisting conditions and monitoring data of a patient's clinical parameters (eg, blood oxygen saturation) to make reliable predictions as to the patient's risk of hospital admission, deterioration, and death. OBJECTIVE: This statistical analysis plan outlines the statistical methods to build the prediction model to be used in the prioritization of patients in the primary care setting. The statistical analysis plan for the RECAP study includes the development and validation of the RECAP-V1 prediction model as a primary outcome. This prediction model will be adapted as a three-category risk score split into red (high risk), amber (medium risk), and green (low risk) for any patient with suspected COVID-19. The model will predict the risk of deterioration and hospitalization. METHODS: After the data have been collected, we will assess the degree of missingness and use a combination of traditional data imputation using multiple imputation by chained equations, as well as more novel machine-learning approaches to impute the missing data for the final analysis. For predictive model development, we will use multiple logistic regression analyses to construct the model. We aim to recruit a minimum of 1317 patients for model development and validation. We will then externally validate the model on an independent dataset of 1400 patients. The model will also be applied for multiple different datasets to assess both its performance in different patient groups and its applicability for different methods of data collection. RESULTS: As of May 10, 2021, we have recruited 3732 patients. A further 2088 patients have been recruited through the National Health Service Clinical Assessment Service, and approximately 5000 patients have been recruited through the DoctalyHealth platform. CONCLUSIONS: The methodology for the development of the RECAP-V1 prediction model as well as the risk score will provide clinicians with a statistically robust tool to help prioritize COVID-19 patients. TRIAL REGISTRATION: ClinicalTrials.gov NCT04435041; https://clinicaltrials.gov/ct2/show/NCT04435041. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/30083.
ABSTRACT
BACKGROUND: During the pandemic, remote consultations have become the norm for assessing patients with signs and symptoms of COVID-19 to decrease the risk of transmission. This has intensified the clinical uncertainty already experienced by primary care clinicians when assessing patients with suspected COVID-19 and has prompted the use of risk prediction scores, such as the National Early Warning Score (NEWS2), to assess severity and guide treatment. However, the risk prediction tools available have not been validated in a community setting and are not designed to capture the idiosyncrasies of COVID-19 infection. OBJECTIVE: The objective of this study is to produce a multivariate risk prediction tool, RECAP-V1 (Remote COVID-19 Assessment in Primary Care), to support primary care clinicians in the identification of those patients with COVID-19 that are at higher risk of deterioration and facilitate the early escalation of their treatment with the aim of improving patient outcomes. METHODS: The study follows a prospective cohort observational design, whereby patients presenting in primary care with signs and symptoms suggestive of COVID-19 will be followed and their data linked to hospital outcomes (hospital admission and death). Data collection will be carried out by primary care clinicians in four arms: North West London Clinical Commissioning Groups (NWL CCGs), Oxford-Royal College of General Practitioners (RCGP) Research and Surveillance Centre (RSC), Covid Clinical Assessment Service (CCAS), and South East London CCGs (Doctaly platform). The study involves the use of an electronic template that incorporates a list of items (known as RECAP-V0) thought to be associated with disease outcome according to previous qualitative work. Data collected will be linked to patient outcomes in highly secure environments. We will then use multivariate logistic regression analyses for model development and validation. RESULTS: Recruitment of participants started in October 2020. Initially, only the NWL CCGs and RCGP RSC arms were active. As of March 24, 2021, we have recruited a combined sample of 3827 participants in these two arms. CCAS and Doctaly joined the study in February 2021, with CCAS starting the recruitment process on March 15, 2021. The first part of the analysis (RECAP-V1 model development) is planned to start in April 2021 using the first half of the NWL CCGs and RCGP RSC combined data set. Posteriorly, the model will be validated with the rest of the NWL CCGs and RCGP RSC data as well as the CCAS and Doctaly data sets. The study was approved by the Research Ethics Committee on May 27, 2020 (Integrated Research Application System number: 283024, Research Ethics Committee reference number: 20/NW/0266) and badged as National Institute of Health Research Urgent Public Health Study on October 14, 2020. CONCLUSIONS: We believe the validated RECAP-V1 early warning score will be a valuable tool for the assessment of severity in patients with suspected COVID-19 in the community, either in face-to-face or remote consultations, and will facilitate the timely escalation of treatment with the potential to improve patient outcomes. TRIAL REGISTRATION: ISRCTN registry ISRCTN13953727; https://www.isrctn.com/ISRCTN13953727. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/29072.